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A METHOD AND SYSTEM FOR A RECOGNITION SYSTEM HAVING A 
VERIFICATION RECOGNITION SYSTEM 



FIELD OF THE INVENTION 
5 The present claimed invention relates to the field of representative 

technology verification. Specifically, the present claimed invention relates to a 
method and system for performing computer implemented recognition and 
verification. 



JlO BACKGROUND ART 

Sj Presently, there are many areas where recorded information can be processed 

* by computer recognition technology. Examples of these areas include voice 
f J information, image information and handwritten information. A computer 
% recognition process can take this information, process it, and format the resulting 
15 data in a beneficial manner. Due to the convenient aspects of computer recognition, 
it is often used in conjunction with an assortment of mobile devices. The list of 
mobile devices which are compatible with computer recognition is extensive and 
includes such items as cell phones, digital recorders, and portable digital assistants 
(PDA's). 

20 

In some mobile devices, the use of computer voice recognition is very 
simplistic. Specifically, in regard to the use of cell phones, voice recognition 
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processes use elementary voice recordings to retrieve a pertinent fact, such as a 
phone number, or to cause an action, such as dialing a phone number. This type of 
voice recognition process relies on specific user pre-recorded information in order to 
facilitate the voice recognition process and only applies to a small set of 
5 predetermined commands. Such a recognition process retains a "command and 
control" type logic and responds only to the correct "do what I say" phraseology. 

In other mobile devices, the use of computer voice recognition is a secondary 
/Jf process which is applied to the recorded data at a later time. For example, voice 
fiO recording devices can be used to record: names and numbers, dates and times, 
M conversations and meetings; among the many possible types of significant sound 
s data. These voice recordings can later undergo a computer recognition processes 
resulting in a formatted version of the underlying recorded sound data. 

15 Specifically, digital recorders and PDA's are often used as memory aids. 

Digital recorders (such as the Olympus DS-320 digital voice recorder) and PDA's 
provide a convenient way to record and recall data. Specifically, while using a 
digital recording device, the user may title each section, or label each smaller ; 
conversation. Further, digital recorders and PDA's can easily be linked to a 

20 computer recognition processes. In one example, they can be used with computer 
voice recognition processes to turn a voice conversation into a text message. In 
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another example, they can be used with computer handwriting recognition 
processes to turn handwritten information directly into a formatted file. 

One disadvantage of computer recognition on digital recorders and PDAs is 
5 that they do not allow for timely recall of information. Specifically, the recorded 
information is retained in voice format on the digital recorder until the connection 
to a computer is made. Upon connection, the recording undergoes computer 
recognition processes, but the user is limited to a specific timeline wherein the 
r? computer recognition can be accomplished. For example, a digital recording that 
W takes place away from the computer recognition system must remain in a digital 
w voice format until such time as the user is able to employ the external computer 
recognition process upon the digital recording. 

U While awaiting the computer recognition process, in order to access the 

1 5 recorded information, the user must navigate through a conversation to arrive at a 
specific point of interest. This procedure is inconvenient and time consuming. For 
example, if a specific portion of a conversation is desired for review, the time 
required for location and replay can result in an inability of the user to concentrate 
upon real-time events. Specifically, during the search procedure, the user could 
20 miss out on important information going on circuitously.' 
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A further problem arises with the inadequacy to amend any portion of the 
recorded data. Once any information is recorded on a device, the linearity of the 
recording process causes difficulty with regard to change. Thus, any amendment to 
the data, while in digital voice format, may require the user to add the amendment 
to a later portion of the recording. This amendment, which would be out of context 
of the original information, could become confusing during the recognition process 
or possibly overlooked by the user upon a cursory review. Further, as the recording 
undergoes the computer recognition process, the resulting amendment may show 
up in a completely different and unrelated section of the resulting formatted 
version. 

Thus, a need exists for a method and system for performing computer 
implemented recognition. A further need exists for a method and system for 
performing computer implemented recognition which performs a timely 
recognition process on a mobile device for user feedback. Yet another need exists for 
a method and system for performing computer implemented which provides a user 
access to the timely recognition results. Still another need exists for a method and 
system for performing computer implemented recognition which allows the timely 
recognition results to be amended. 
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SUMMARY OF INVENTION 

The present invention provides, in various embodiments, a method and 
system for performing computer implemented recognition. Embodiments of the 
present invention also provide a method and system for performing computer 
5 implemented recognition which meets the above need and which performs a timely 
recognition process on a mobile device for user feedback. The present invention 
further provides a method and system for performing computer implemented 
recognition which meets the above needs and which provides a user access to the 
timely recognition results. The present invention also provides a method and 
10 system for performing computer implemented recognition which meets the above 
needs and which allows the timely recognition results to be amended. 

Specifically, in one embodiment, the present invention first accesses user 
input stored in a memory of a mobile device* On the mobile device, the present 

15 invention performs a coarse recognition process on the user input to generate a 
coarse result. The coarse process may operate in real-time. The embodiment then 
displays a portion of the coarse result on a display screen of the mobile device. The 
embodiment further performs a detailed recognition process on the user input to 
generate a detailed result. The detailed process has more recognition patterns and 

20 computing resources available to it. The present embodiment performs a 

comparison of the detailed result and the coarse result. The present embodiment 
displays a portion of the comparison on the display screen. 
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In one embodiment, the detailed process may be a background process 
operable on the mobile device. In another embodiment, the detailed recognition 
process operates on an external computer system. The input data can be speech, 
handwritten stroke data, image data, etc. The detailed recognition system has more 
computing resources available to it, while the coarse recognition process is tailored 
to be a real-time feedback recognition. It is appreciated that normally the result of 
the detailed recognition process takes precedence over the coarse result. Any 
manual changes to the coarse result take precedence over the detailed results. 

These and other advantages of the present invention will no doubt become 
obvious to those of ordinary skill in the art after having read the following detailed 
description of the preferred embodiments which are illustrated in the various 
drawing figures. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The accompanying drawings, which are incorporated in and form a part of 
this specification, illustrate embodiments of the invention and, together with the 
description serve to explain the principles of the invention; 

5 

FIGURE 1 is a block diagram of an exemplary communication network in 
which the exemplary computing system can be used in accordance with one 
embodiment of the present invention. 

CjlO FIGURE 2 is a block diagram of exemplary circuitry of a computing system in 

yQ accordance with one embodiment of the present invention. 

jr FIGURE 3 is a block diagram of exemplary process of two or more separate 

[7 computing systems in accordance with one embodiment of the present invention. 

jll5 

FIGURE 4 is a block diagram or exemplary process of a combined computing 
system in accordance with one embodiment of the present invention. 

FIGURE 5 is a block diagram or exemplary process of a combined computing 
20 system and two or more separate computing systems in accordance with one 
embodiment of the present invention. 
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FIGURE 6 is a flow chart of steps in an exemplary method for performing 
computer implemented recognition, in accordance with one embodiment of the 
present invention. 

FIGURE 7 is a flow chart of steps in an exemplary method for performing 
computer implemented recognition, in accordance with one embodiment of the 
present invention. 

FIGURES 8A-B are examples of the exemplary results, in accordance with one 
embodiment of the present invention. 

The drawings referred to in this description should be understood as not 
being drawn to scale except if specifically noted. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following detailed description of the present invention, a method and 
system for performing computer implemented recognition and recognition 
verification, specific details are set forth in order to provide a thorough 
5 understanding of the present invention* However, it will be recognized by one 
skilled in the art that the present invention may be practiced without these specific 
details or with equivalents thereof. In other instances, well-known methods, 
procedures, components, and circuits have not been described in detail as not to 

J unnecessarily obscure aspects of the present invention. 

W 

h NOTATION AND NOMENCLATURE 

^ Some portions of the detailed descriptions that follow are presented in terms 

K of procedures, steps, logic blocks, processing, and other symbolic representations of 
y, operations on data bits within a computer memory. These descriptions and 
HL5 representations are the means used by those skilled in the data processing arts to 
most effectively convey the substance of their work to others skilled in the art. A 
procedure, computer executed step, logic block, process, etc., is here, and generally, 
conceived to be a self-consistent sequence of steps or instructions leading to a desired 
result. The steps are those that require physical manipulations of physical 
20 quantities. Usually, though not necessarily, these quantities take the form of 
electrical or magnetic signals capable of being stored, transferred, combined, 
compared, and otherwise manipulated in a computer system. It has proven 
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convenient at times, principally for reasons of common usage, to refer to these 
signals as bits, values, elements, symbols, characters, terms, numbers, or the like. 

It should be borne in mind, however, that all of these and similar terms are to 
5 be associated with the appropriate physical quantities and are merely convenient 
labels applied to these quantities. Unless specifically stated otherwise as apparent 
from the following discussions, it is appreciated that throughout the present 
invention, discussions utilizing terms such as "accessing", "performing", 
y "displaying", "determining" or the like, refer to the action and processes of a 
30 computer system (e.g., Figure 2), or similar electronic computing device, that 

manipulates and transforms data represented as physical (electronic) quantities 
H within the computer system's registers and memories into other data similarly 

is 

H*. represented as physical quantities within the computer system memories or 
?7 registers or other such information storage, transmission or display devices. 

EJs 

Aspects of the present invention, described below, are discussed in terms of 
steps executed on a computer system. These steps (e.g., processes 600 and 700) are 
implemented as program code stored in computer readable memory units of 
computer systems and are executed by the processor of the computer system. 
20 Although a variety of different computer systems can be used with the present 
invention, an exemplary wireless computer system is shown in Figure 2 below. 
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Referring now to Figure 1, a system 50 that may be used in conjunction with 
the present invention is shown. It is appreciated that the method and system for 
performing computer implemented recognition can be used in conjunction with 
any computer system and that system 50 is illustrative rather than limiting. It is 
further appreciated that the portable computer system 112 (hereafter known as 
mobile device 112) described below is only exemplary. System 50 comprises a host 
computer system 56 which can either be a desktop unit as shown, or, alternatively, 
can be a laptop computer system 58. Optionally, one or more host computer systems 
can be used within system 50. Host computer systems 58 and 56 are shown 
connected to a communication bus 54, which in one embodiment can be a serial 
communication bus, but could be of any of a number of well known designs, e.g., a 
parallel bus, Ethernet, Local Area Network (LAN), etc. Optionally, bus 54 can 
provide communication with the internet 52 using a number of well-known 
protocols. 

Importantly, bus 54 is also coupled to a wireless communications device 60 
for receiving and initiating communication with mobile device 112. Mobile device 
112 also contains a wireless communication mechanism 64 for sending and 
receiving information from other devices. The wireless communication 
mechanism 64 can use infrared communication or other wireless communications 
such as a Bluetooth protocol. 
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Referring now to Figure 2, a block diagram of exemplary mobile device 112 is 
shown. Mobile device 112 includes an address/data bus 100 for communicating 
information, a central processor 101 coupled with bus 100 for processing 
information and instructions, a volatile memory unit 102 (e.g., random access 
5 memory, static RAM, dynamic RAM, etc.) coupled with bus 100 for storing 

information and instructions for central processor 101 and a non-volatile memory 
unit 103 (e.g., read only memory, programmable ROM, flash memory, EPROM, 
EEPROM, etc.) coupled with bus 100 for storing static information and instructions 
tf for processor 101. As described above, mobile device 112 also contains an optional 
5(0 display device 105 coupled to bus 100 for displaying information to the computer 
h user. As described further below, portions of memory units 102 and 103 can be 

removed from mobile device 112. Moreover, mobile device 112 also includes a data 
Jf storage device 104 (e.g., memory stick) for storing information and instructions. In 
f? one embodiment, data storage device 104 is removable from mobile device 112. 

jis 

Mobile device 112 also includes an optional cursor control or directing device 
107 coupled to bus 100 for communicating user input information and command 
selections to central processor 101. In one implementation, device 107 is a touch 
screen device incorporated with optional display device 105. In this 
20 implementation, device 107 is capable of registering a position on optional display 
device 105 where a stylus makes contact. Optional display device 105 utilized with 
mobile device 112 may be a liquid crystal device (LCD), cathode ray tube (CRT), field 
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emission device (FED, also called flat panel CRT) or other display device suitable for 
creating graphic images and alphanumeric characters recognizable to the user. In 
one embodiment, optional display device 105 is a flat panel display. Mobile device 
112 also includes signal communication interface 108, which is also coupled to bus 
5 100. Communication interface 108 includes an input device such as an audio 
recording interface as well as a number of wireless communication mechanisms 
such as infrared or a Bluetooth protocol. 

€1 It is appreciated that mobile device 112 described herein illustrates an 

30 exemplary configuration of an operational platform upon which embodiments of 

J? the present invention can be implemented. Nevertheless, other computer systems 

s " with differing configurations can also be used in place of mobile device 112 within 

O the scope of the present invention. 

Mi 

r 15 One embodiment of the system is disclosed in Figure 3. Specifically, as shown 

in Figure 3, the present invention can include, but is not limited to, user input 302 
and two computing systems. In one embodiment, user input 302 may be speech 
data, handwritten stroke data, image data, etc. In one embodiment, the two 
computing systems are mobile device 112 and computing system 56. Specifically, in 
20 one embodiment, mobile device 112 includes coarse recognition engine 306. In one 
embodiment, coarse recognition engine 306 is a software program that runs on a 
computer. Further, in one embodiment, a number of different recognition 
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processes can be used with coarse recognition engine 306. Alternatively, in one 
embodiment, coarse recognition engine 306 may be a specially designed hardware 
piece made specifically for real-time voice recognition. 

In one embodiment, mobile device 112 includes coarse result 308. In one 
embodiment, coarse result 308 is the output of coarse recognition engine 306. 
Specifically, coarse result 308 is a representation of user input 302 after it has 
completed the recognition processes of coarse recognition engine 306. 

In one embodiment, mobile device 112 includes modified result 312. In one 
embodiment, modified result 312 may be a representation of coarse result 308 and 
detailed result 310. In one embodiment, detailed result 310 is generated by 
computing system 56. Specifically, in one embodiment, with regard to modified 
result 312, computing system 56 has more computing resources available to it, while 
coarse recognition engine 306 is tailored to be a real-time feedback recognition. 
Thus, it is appreciated that, in one embodiment, detailed result 310 takes precedence 
over coarse result 308 as processed by modified result 312. Further, in one 
embodiment, any manual changes to coarse result 308 take precedence over detailed 
result 310 as processed by modified result 312. 

With reference now to step 602 of Figure 6 and to Figure 3, the present 
invention accesses user input 302 stored in a memory 102 of mobile device 112. In 
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one embodiment memory 104 may be used. In one embodiment, user input 302 
may be speech data. In another embodiment, user input 302 may be handwritten 
stroke data. In yet another embodiment, user input 302 may be image data. 

5 With reference now to step 604 of Figure 6 and to Figure 3, in one 

embodiment, the present invention, on mobile device 112, performs a coarse 
recognition process on user input 302 to generate coarse result 308. User input 302 
may come directly from an input device or may be accessed from memory 102. In 

C one embodiment, the input device may be communication interface 108. Coarse 
iff: recognition engine 306 may be implemented as a software recognition process using 
a number of well known recognition techniques. In one embodiment, the coarse 

SI recognition process takes place at coarse recognition engine 306. In one 

H embodiment, coarse recognition engine 306 is constrained by allowable response 
time and attempts to operate in real-time. In another embodiment, coarse 

ISf recognition engine 306 is constrained by computing resources. 

With reference now to step 606 of Figure 6 and to Figure 3, in one 
embodiment, the present invention displays a portion of coarse result 308 on a 
display screen on mobile device 112. In one embodiment, the display screen on 
20 mobile device 112 is optional display device 105. Although optional display device 
105 is explicitly mentioned, the present invention is well suited to the use of a 
display screen on mobile device 112 other than optional display device 105. 
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Referring now to step 608 of Figure 6 and to Figure 3, in one embodiment, the 
present invention establishes a data link between mobile device 112 and another 
computing system 56 separate from mobile device 112. In one embodiment, the data 
link established between mobile device 112 and computing system 56 is wireless. In 
yet another embodiment, the data link established between mobile device 112 and 
computing system 56 is wired. Although in the present embodiment, computing 
system 56 is explicitly mentioned, the present invention is well suited to the use of 
computing system 58 or any other separate computing system. Further, the 
reference to computing system 56 throughout the embodiment of the present 
invention is maintained merely for purposes of brevity and clarity. 

With reference now to step 610 of Figure 6 and to Figure 3, in one method 
embodiment, user input 302 is transferred to computing system 56. In one method 
embodiment, coarse result 308, or a portion of coarse result 308, is transferred to 
another computing system 56 separate from mobile device 112 in conjunction with 
user input 302. In one embodiment, the transfer of coarse result 308, or a portion of 
coarse result 308, and user input 302 takes place wirelessly using communications 
device 60 for receiving and initiating communication with a wireless mobile device 
112. In another embodiment, the transfer of coarse result 308, or a portion of coarse 
result 308, and user input 302 takes place wirelessly using communication 
mechanism 64. The wireless communication mechanism 64 can use infrared 
communication or other wireless communications such as a Bluetooth protocol. 
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With reference now to step 612 of Figure 6 and to Figure 3, in one 
embodiment, the present invention performs a detailed recognition process on user 
input 302 to generate detailed result 310. In one embodiment, computing system 56 
maintains a data link with mobile device 112 during the detailed recognition 
5 process. In one embodiment, computing system 56 does not maintain a data link 
with mobile device 112 during the detailed recognition process. Further, in one 
embodiment, the present invention performs a detailed recognition process on user 
input 302 in conjunction with coarse result 308, or a portion of coarse result 308, to 
p i; generate detailed result 310. In one embodiment, detailed result 310 is generated on 
jp computing system 56. Specifically, in one embodiment, computing system 56 is not 
P constrained by allowable response time. Further, in one embodiment, computing 
"H system 56 is not constrained by computing resources. Detailed recognition process 

I s may be implemented as a software process to recognize the user input. This detailed 

II process, as compared to the coarse process, has more pre-stored recognition patterns, 
fS5 has more memory and processing power, and is independent of response time. As a 

result, this detailed recognition system can be used as a verification for coarse result 
308. 



With reference now to step 614 of Figure 6 and to Figure 3, in one 
20 embodiment, the present invention transfers detailed result 310 from another 
computing system 56 to mobile device 112. In one embodiment, the transfer of 
detailed result 310 takes place wirelessly using communications device 60 for 
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receiving and initiating communication with a wireless mobile device 112. In 
another embodiment, the transfer of detailed result 310 takes place wirelessly using 
communication mechanism 64. The wireless communication mechanism 64 can 
use infrared communication or other wireless communications such as a Bluetooth 
5 protocol. 

With reference now to step 616 of Figure 6 and to Figure 3, in one 
embodiment, the present invention performs a comparison of detailed result 310 
G and coarse result 308. Referring now to step 618 of Figure 6 and to Figure 3, in one 
tl embodiment, the present invention displays a portion of the comparison on display 
% screen 105. In one embodiment, modified result 312 is the comparison of detailed 
Cj result 422 and coarse result 308. For example, Figure 8A shows one embodiment 
h wherein mobile device 112 accesses user input 302. User input 302 stated "eleven 

am, lunch with dom/' Figure 8A shows coarse result 308 as shown on optional 
55 display device 105 as "eleven am, lunch with don/' 

Further, Figure 8B shows one embodiment wherein, the present invention 
performs a detailed recognition process which results in "eleven am, lunch with 
dom/' In one embodiment, the present invention performs a comparison of 
20 detailed result 310 and coarse result 308. In one embodiment, as shown in Figure 
8B, the difference between detailed result 310 and coarse result 308 is emphasized 
with visual script differentiation in modified result 312. It is appreciated that any 
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user modifications made to coarse result 308 would take precedence over detailed 
result 310. 

A second embodiment of the system is disclosed in Figure 4. Specifically, as 
shown in Figure 4, the present invention can include, but is not limited to, user 
input 302 and mobile device 112. In one embodiment, user input 302 may be speech 
data, handwritten stroke data, image data, etc. Specifically, in one embodiment, 
mobile device 112 includes coarse recognition engine 306. In one embodiment, 
coarse recognition engine 306 is a software program that runs on a computer. 
Further, in one embodiment, a number of different recognition processes can be 
used with coarse recognition engine 306. Alternatively, in one embodiment, coarse 
recognition engine 306 may be a specially designed hardware piece made specifically 
for real-time voice recognition. 

In one embodiment, mobile device 112 includes coarse result 308. In one 
embodiment, coarse result 308 is the output of coarse recognition engine 306. 
Specifically, coarse result 308 is a representation of user input 302 after it has 
completed the recognition processes of coarse recognition engine 306. 

In one embodiment, mobile device 112 includes background recognition 
system 420. In one embodiment, background recognition system 420 can be very 
similar to coarse recognition engine 306. That is, in one embodiment background 
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recognition system 420 can be a software program that runs on a computer. Further, 
in one embodiment, a number of different recognition processes can be used with 
background recognition system 420. Alternatively, in one embodiment, background 
recognition system 420 can be a specially designed hardware piece made specifically 
5 for detailed voice recognition. 

In one embodiment, mobile device 112 includes modified result 312. In one 
embodiment, modified result 312 may be a representation of coarse result 308 and 
p detailed result 422. In one embodiment, detailed result 422 is generated by 
ill background recognition system 420. Specifically, in one embodiment, with regard to 
%1 modified result 312, background recognition system 420 has more computing 

resources available to it, while coarse recognition engine 306 is tailored to be a real- 
ly time feedback recognition. Thus, it is appreciated that, in one embodiment, detailed 
u result 422 takes precedence over coarse result 308 as processed by modified result 312. 
15 Further, in one embodiment, any manual changes to coarse result 308 take 
precedence over detailed result 422 as processed by modified result 312. 

With reference now to step 702 of Figure 7 and to Figure 4, the present 
invention accesses user input 302 stored in a memory 102 of mobile device 112. In 
20 one embodiment, memory 104 may be used. In one embodiment, user input 302 
may be speech data. In another embodiment, user input 302 may be handwritten 
stroke data. In yet another embodiment, user input 302 may be image data. 
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With reference now to step 704 of Figure 7 and to Figure 4, in one 
embodiment, the present invention, on mobile device 112, performs a coarse 
recognition process on user input 302 to generate coarse result 308. User input 302 
may come directly from an input device or may be accessed from memory 102. In 

5 one embodiment, the input device may be communication interface 108. The coarse 
recognition engine may be implemented as a software recognition process using a 
number of well known recognition techniques. In one embodiment, the coarse 
recognition process takes place at coarse recognition engine 306. In one 

O embodiment, coarse recognition engine 306 is constrained by allowable response 

W[ time and attempts to operate in real-time. In another embodiment, coarse 

5 recognition engine 306 is constrained by computing resources. 

L With reference now to step 706 of Figure 7 and to Figure 4, in one 

C embodiment, the present invention displays a portion of coarse result 308 on a 
11 display screen on mobile device 112. In one embodiment, the display screen on 
mobile device 112 is optional display device 105. 

Referring now to step 708 of Figure 7 and to Figure 4, in one method 
embodiment, user input 302, which is stored in memory 102, is transferred to 
20 background recognition system 420. In one method embodiment, coarse result 308, 
or a portion of coarse result 308, is transferred to background recognition system 420 
in conjunction with user input 302. 
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Referring now to step 710 of Figure 7 and to Figure 4, in one embodiment, the 
present invention performs a detailed recognition process on user input 302 to 
generate detailed result 422. Further, in one embodiment, detailed result 422 is 
generated on background recognition system 420 of mobile device 112. In one 
embodiment, the present invention generates detailed result 422 during background 
processing of mobile device 112. Specifically, in one embodiment, background 
recognition system 420 is not constrained by response time. Further, in one 
embodiment, background recognition system 420 is not constrained by computing 
resources. 

With reference now to step 712 of Figure 7 and to Figure 4, in one 
embodiment, the present invention transfers detailed result 422 from background 
recognition system 420 to a foreground application of mobile device 112. Referring 
now to step 714 of Figure 7 and to Figure 4, in one embodiment, the present 
invention performs a comparison of detailed result 422 and coarse result 308. In one 
embodiment, modified result 312 is the comparison of detailed result 422 and coarse 
result 308. 

With reference now to step 716 of Figure 7 and to Figure 4, in one 
embodiment, the present invention displays a portion of the comparison on display 
screen 105. Therefore, the same example as the previous embodiment again applies, 
that is, Figure 8A shows one embodiment wherein mobile device 112 accesses user 
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input 302. User input 302 stated "eleven am, lunch with dom." Figure 8 A shows 
coarse result 308 as shown on optional display device 105 as "eleven am, lunch with 
don." 

5 Further, Figure 8B shows one embodiment wherein, the present invention 

performs a detailed recognition process which results in "eleven am, lunch with 
dom." In one embodiment, the present invention performs a comparison of 
detailed result 422 and coarse result 308. In one embodiment, as shown in Figure 
5 9B, the difference between detailed result 422 and coarse result 308 is emphasized 
Jb with visual script differentiation in modified result 312. It is appreciated that any 
J user modifications made to coarse result 308 would take precedence over detailed 
Si result 422. 

f Although, in one embodiment, the difference between detailed result 422 and 

5j5 coarse result 308 is emphasized with visual script differentiation in modified result 
312, the present invention is well suited to the use of many types of differentiation 
identification in modified result 312. Further, the present invention is well suited 
to the use of no type of differentiation identification in modified result 312. The 
present embodiment maintained visual script differentiation in modified result 312 
20 merely for purposes of clarity. 
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Another embodiment of the recognition system is disclosed in Figure 5. 
Specifically, in one embodiment, as shown in Figure 5, the present invention can 
include, but is not limited to, both aspects of Figures 3 and 4. That is, in one 
embodiment, the recognition system is comprised of a mobile device 112 and 
5 computing system 56. Further, mobile device 112 includes background recognition 
system 420. For purposes of brevity and clarity only the differences with regard to 
the recognition system as shown in Figure 5 will be emphasized. 

O Specifically, in one embodiment, the recognition system as shown in Figure 5 

ft comprises both of the previously mentioned embodiments. Further, in one 
Jl; embodiment, the recognition system as shown in Figure 5 differs only in the 
Ct method in which modified result 312 is processed. Specifically, with regard to 
H modified result 312 of Figure 5, the present invention performs a comparison of 
^ detailed result 310, detailed result 422 and coarse result 308. Specifically, in one 
F|5 embodiment, with regard to modified result 312, background recognition system 420 
has more computing resources available to it, while coarse recognition engine 306 is 
tailored to be a real-time feedback recognition. Thus, it is appreciated that, in one 
embodiment, detailed result 422 takes precedence over coarse result 308 as processed 
by modified result 312. However, in one embodiment, computing system 56 has 
20 more computing resources available to it than background recognition system 420. 
Therefore, it is appreciated that, in one embodiment, detailed result 310 takes 
precedence over detailed result 422 and coarse result 308 as processed by modified 
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result 312. Further, in one embodiment, any manual changes to coarse result 308 
take precedence over detailed result 422 and detailed result 310 as processed by 
modified result 312. 

5 Thus, the present invention provides, in various embodiments, a method 

and system for performing computer implemented recognition and verification. 
The present invention also provides a method and system for performing computer 
implemented recognition which meets the above need and which performs a timely 
D recognition process on a mobile device for user feedback. The present invention 
If further provides a method and system for performing computer implemented 
? recognition which meets the above needs and which provides a user access to the 
J! timely recognition results. The present invention also provides a method and 
L, system for performing computer implemented recognition which meets the above 
C needs and which allows the timely recognition results to be amended. 
1 

The foregoing descriptions of specific embodiments of the present invention 
have been presented for purposes of illustration and description. They are not 
intended to be exhaustive or to limit the invention to the precise forms disclosed, 
and obviously many modifications and variations are possible in light of the above 
20 teaching. The embodiments were chosen and described in order to best explain the 
principles of the invention and its practical application, to thereby enable others 
skilled in the art to best utilize the invention and various embodiments with 
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various modifications are suited to the particular use contemplated. It is intended 
that the scope of the invention be defined by the Claims appended hereto and their 
equivalents. 
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